arXiv:1503.00046v2 [physics.optics] 7 May 2015 


Bayesian-based aberration correction and numerical diffraction for 
improved lensfree on-chip microscopy of biological specimens 


Alexander Wong, 1 !] 


Farnoud Kazemzadeh , 1 


Chao Jin , 2 and Xiao Yu Wang 1 


1 Department of Systems Design Engineering, University of Waterloo, 

200 University Ave. West, Waterloo, Ontario, N2L SGI 
2 Department of Civil and Environmental Engineering, University of Waterloo, 
200 University Ave. West, Waterloo, Ontario, N2L SGI 


compiled: May 11, 2015 


Lensfree on-chip microscopy is an emerging imaging technique that can be used to visualize and study biological 
specimens without the need for imaging lens systems. Important issues that can limit the performance of 
lensfree on-chip microscopy include interferometric aberrations, acquisition noise, and image reconstruction 
artifacts. In this study, we introduce a Bayesian-based method for performing aberration correction and 
numerical diffraction that accounts for all three of these issues to improve the effective numerical aperture 
(NA) and signal-to-noise ratio (SNR) of the reconstructed microscopic image. The proposed method was 
experimentally validated using the USAF resolution target as well as real waterborne Anabaena flos-aquae 
samples, demonstrating improvements in NA by ~25% over the standard method, and improvements in SNR 
of 2.8 dB and 8.2 dB in the reconstructed image when compared to the reconstructed images produced using 
the standard method and a maximum likelihood estimation method, respectively. 

OCIS codes: (090.1995) Digital holography; (100.3190) Inverse problems; (100.3010) Image recon¬ 

struction techniques. 
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Lensfree on-chip microscopy M is an emerging imag¬ 
ing microscopy technique capable of non-contact, high res¬ 
olution imaging of specimens at the sub-micron scales. In 
lensfree on-chip microscopy, a coherent or partially coher¬ 
ent light source is utilized to illuminate a specimen. The 
light-matter interaction results in an interference pattern 
which is then observed and digitally acquired on an array 
detector as a hologram. Using numerical diffraction, mi¬ 
croscopic images can be reconstructed from the holograms. 

There are several benefits to lensfree on-chip microscopy. 
Since the specimen is placed very close to the image sen¬ 
sor array (e.g., < 5 mm), it allows for highly compact 
and field-portable microscopy systems. Furthermore, con¬ 
trary to conventional lens-based microscopy techniques, 
the field-of-view (FOV) is equal to the active area of the 
image sensor array and as such allows for large FOVs while 
maintaining high spatial resolution that increase with de¬ 
creasing pixel pitch in new sensor arrays [jJ. Addition¬ 
ally, lensfree on-chip microscopy facilitates naturally for 
quantitative phase contrast microscopy without the need 
to distort the bright field image like more complex methods 
such as differential interference contrast (DIC) microscopy. 
Therefore, given all these benefits as well as its ability 
to visualize and quantify optical properties of transparent 
and semi-transparent specimens in a non-invasive manner, 
lensfree on-chip microscopy has begun to gain significant 
interest for the visualization and study of biological spec- 
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imens such as sperm [H|, waterborne algae Q, waterborne 
parasites [iTj, and premalignant/malignant cells [§, ,9j. 

There are several important issues that can limit the 
overall performance of lensfree on-chip microscopy sys¬ 
tems. First, the NA of a lensfree on-chip microscopy sys¬ 
tem is limited by the pixel size of the sensor array used. 
Second, system factors such as the pixel responsivity of the 
image sensor array [ij can result in interferometric aberra¬ 
tions that appear as distortions and/or defocusing, hence 
adversely affecting the effective NA of the reconstructed 
image. Third, the quality of the reconstructed image is 
highly sensitive to the SNR of the recorded hologram, mak¬ 
ing it difficult to achieve high image reconstruction perfor¬ 
mance under low SNR imaging conditions. Fourth, due 
to the nature of the recorded hologram and the numerical 
diffraction process, reconstruction artifacts such as ringing 
artifacts are often introduced, thus also reducing the effec¬ 
tive SNR of the reconstructed image. As such, methods 
for dealing with these important issues are highly desired 
to improve the effective NA and SNR of the reconstructed 
image for lensfree on-chip microscopy systems. 

Much of existing literature in lensfree on-chip mi¬ 
croscopy has focused on dealing with the first issue of 
pixel size limitations through the use of superresolution 
techniques jH H|-[l3|. In such approaches, a stack of lower 
resolution holograms of the same specimen, acquired at 
different subpixel offsets thus each containing unique infor¬ 
mation about the specimen, are numerically combined to 
form a higher resolution hologram. While such superres¬ 
olution techniques can significantly improve the effective 
NA, they require more complex components in the optical 
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Fig. 1. Experimental lensfree on-chip microscopy setup. L is 
the light source, P is the aperture, a 75 (im pinhole, S is the 
sample, and D is the detector. 

system (e.g., mechanical micro-stage [l2j) to achieve sub¬ 
pixel offsets. Fewer existing literature in lensfree on-chip 
microscopy have dealt with the second issue of interfer¬ 
ometric aberrations. Of particular interest is the semi¬ 
nal work by 3, where these aberrations were character¬ 
ized down to the pixel responsivity of the sensor array, 
and a maximum likelihood (ML) estimation approach [141] 
was used to perform aberration correction on the recorded 
hologram based on the characterization. While this re¬ 
sulted in significant gains in effective NA, it also resulted 
in significant undesirable reconstruction artifacts. 

To deal with the issue of hologram noise, methods such 
as [H taking the Poisson characteristics of photon noise 
were taken into account in the ML estimation approach 
when performing aberration correction; however, the noise 
persists in the reconstructed image thus leading to reduced 
SNR. Furthermore, for the case of lensless on-chip mi¬ 
croscopy of biological specimens, the variance of param¬ 
eter estimates are high for the ML approach, leading to 
results that are highly dominated by variations in data. 
To perform further noise removal and compensation, post¬ 
processing methods have been proposed without taking 
the inherent noise statistics into account jl5l4T8j . Fur¬ 
thermore, the issue associated with reconstruction artifacts 
such as ringing artifacts due to the nature of the numerical 
diffraction process are not well explored. In addition, each 
of these issues are primarily dealt with one at a time in 
existing literature, which can lead to suboptimal results as 
the issues are not taken into consideration concurrently. 

In this study, we investigate and attempt to mitigate 
the last three aforementioned issues (interferometric aber¬ 
ration, acquisition noise, and reconstruction artifacts) by 
introducing a Bayesian-based method for performing aber¬ 
ration correction and numerical diffraction that takes into 
account all three issues in unison. By incorporating prior 
models related to interferometric aberrations, acquisition 
noise, and reconstruction artifacts, one can compensate 
for these issues within a unified framework to improve the 
effective NA and SNR of the reconstructed image when 
compared to addressing these issues independently. Fur¬ 
thermore, the proposed Bayesian-based method employs 
a Maximum a Posteriori (MAP) strategy, which provides 
improvements over an ML approach by adding bias which 
leads to variance reduction. This is especially beneficial for 
the application of lensless on-chip microscopy of biological 
specimens and acts as a key novelty of the proposed work. 

In the proposed method, we model the desired lensfree 
on-chip microscopy image (/) (at z with wavelength A), 
and the measured hologram ( g ) as probability distribu- 



Fig. 2. A region of the USAF resolution target results. Recon¬ 
structed lensfree images using (a) standard method, (b) ML 
estimation Q, and (c) the proposed method. The SNR was 
assessed in a region shown by the orange box, and the DI jl9| 
was evaluated in the orange box (to assess noise level) as well 
as the whole image (to assess contrast improvement). 

tions. In the proposed Bayesian-based method, the goal 
is to determine the most probable desired image / given 
the measured hologram g , based on prior knowledge re¬ 
lated to /, knowledge of the transfer function associated 
with aberrations ( H a ), as well as the numerical diffraction 
transfer function (Hd, z ,\) (the Fresnel transform, Huygens 
convolution, and angular spectrum methods for numerical 
diffraction can all be expressed as a convolution). This can 
be formulated as the following MAP problem: 

/ = argmax ; p(f\g ), (1) 

where p ( f\g ) is the conditional probability of / given g. By 
solving this problem, we effectively perform both numer¬ 
ical diffraction and aberration correction to obtain a cor¬ 
rected, reconstructed image. This problem can be equiva¬ 
lently formulated as: 


/ = argmaxj p (g\f)p(f), (2) 

where p(g\f) is the likelihood and p(f) is the prior. 

Let S' be a set of pixel locations in the image sensor array 
and s G S be a specific pixel location in the sensor array. 
In the case of lensfree on-chip microscopy, acquisition noise 
is primarily related to quantum photon emission. As such, 
to account for the statistics of this noise in the proposed 
method, along with aberrations (characterized by H a ) and 
numerical diffraction (characterized by Hd, z ,\)i we incor¬ 
porate the following likelihood p(g\f): 


’(si/)= n 
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Fig. 3. Zoomed-in regions of the Anabaena flos-aquae sam¬ 
ple. (h) acquired hologram; (d) reference 40X microscopy im¬ 
age; reconstructed lensfree amplitude images using (a) standard 
method, (b) ML estimation 4|, (c) and the proposed method; 
reconstructed lensfree phase images using (e) standard method, 
(f) ML estimation, (g) and the proposed method. Contrast ad¬ 
justed for better visualization. The scale bar denotes 20 /im. 


where 5 and 5 _1 denotes the forward and inverse Fourier 
transform, respectively. To compensate for the presence of 
reconstruction artifacts such as ringing artifacts due to the 
nature of lensfree on-chip microscopy, we explicitly enforce 
a prior model p(f) where we model / as a nonstationary 
process with a nonstationary expectation E(f s ) and a vari¬ 
ance t 2 : 


P(/) = II' 


( fs-E(.f s )r 


ses 


( 4 ) 


In the proposed method, the nonstationary expectation 
E(f s ) is estimated via the nonparametric expectation es¬ 
timation method introduced in [2Cj as it was shown to 
provide reliable estimates even under low SNR scenarios. 
As such, the issues associated with interferometric aber¬ 
rations, acquisition noise, and reconstruction artifacts are 
taken into account in unison in the proposed method via 
the likelihood p(g\f) and prior model p(f) presented in 
Eq. [3] and Eq. [4] to provide an improved estimate of /. 
To obtain a corrected, reconstructed image /, the MAP 
problem posed in Eq. [2] and is solved using the iterative 
optimization method described in [20j. 

To demonstrate the efficacy of the proposed method for 
improving effective NA and SNR of the reconstructed im¬ 
age for lensfree on-chip microscopy, the method was val¬ 
idated using both the USAF resolution target and wa¬ 
terborne Anabaena flos-aquae samples. For this study, a 
lensfree on-chip microscope was constructed (see Fig. |T] 
for experimental configuration). The partially-colierence 
light source used was a A = 525 nm, 7 mW light emit¬ 
ting diode (Thorlabs LED528EHP), and the interferomet¬ 
ric hologram was observed and digitally acquired using a 
1600x1200 pixel CMOS sensor array (IDS-UI-1250LE-M- 
GL) with a pixel pitch of 4.5 pm. The FOV of the micro¬ 
scope is determined by the active sensor size and is ~ 39 
mm 2 . The lensfree on-chip microscope was characterized 


based on image acquisitions of the USAF resolution target 
to estimate the aberration transfer function H a using a 
least-squares optimization approach relative to an aligned 
ground-truth USAF resolution target image. Given the 
recorded holograms from the lensfree on-chip microscope, 
the aberration transfer function H a , and the Huygens nu¬ 
merical diffraction transfer function Hd. z ,\ 7 the proposed 
method was run for 35 iterations to produce the final mi¬ 
croscopic image. For comparison purposes, the maximum 
likelihood (ML) estimation method described in jdj was 
also tested, with the number of iterations also set to 35 it¬ 
erations and Hyugens numerical diffraction used for exper¬ 
imental consistency. As a baseline reference, direct Hyu¬ 
gens numerical diffraction of the recorded hologram is also 
performed (we will refer to this as the standard method). 

Fig. [2] shows a zoomed-in region from the lensfree am¬ 
plitude images of the USAF resolution target using the 
standard method, ML estimation [4J, and the proposed 
method. It can be observed that the horizontal and verti¬ 
cal lines of group 6 element 2 are resolved using the stan¬ 
dard method, while the horizontal lines of group 6 element 
6 and vertical lines of group 6 element 5 are resolved us¬ 
ing the proposed method. These elements are considered 
to be resolved if the the width of the lines and separation 
between the lines are spanned by at least two pixels in 
the reconstructed images. The per-pixel resolution of the 
lensfree microscope is then determined by the separation 
distance between the lines of the USAF target divided by 
the number of pixels spanning the said distance. The pro¬ 
posed method was able to achieve a gain of ~ 25% in NA 
over the reconstructed lensfree amplitude image using the 
standard method. 

The SNR for all three lensfree amplitude images was 
assessed, with the SNR of the reconstructed lensfree am¬ 
plitude image using standard method at 27.2 dB, the SNR 
of the reconstructed lensfree amplitude image using the 
ML estimation method at 21.8 dB, and the SNR of the re¬ 
constructed lensfree amplitude image using the proposed 
method at 30.0 dB. Based on these results, it can be ob¬ 
served that the proposed method was able to achieve a 
gain of 2.8 dB over the standard method and 8.2 dB over 
the ML estimation method. 

Furthermore, the Dispersion Index (DI) [l9| was as¬ 
sessed for a homogeneous region (see Fig. [2])a)) to assess 
noise level (lower DI here indicates lower noise levels), and 
for the whole image to assess contrast enhancement (higher 
DI here indicates better contrast enhancement). The DI 
achieved was 0.04/0.27 (homogeneous/whole-image) us¬ 
ing the standard method, 0.08/0.30 using the ML estima¬ 
tion method, and 0.03/0.29 using the proposed method. 
Based on these results, it can be observed that the pro¬ 
posed method achieved a lower DI in the homogeneous 
region that the standard and ML methods, which in¬ 
dicates that the proposed method achieved the lowest 
noise level. Furthermore, the proposed method achieved 
a higher whole-image DI than the standard method and 
comparable whole-image DI to the ML method, which in¬ 
dicates that the proposed method achieved improved con¬ 
trast compared to the standard method and similar con¬ 
trast as the ML method. 

To validate the proposed method using real biological 
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samples, cells of a laboratory pure culture of the cyanobac¬ 
teria Anabaena flos-aquae which is a neurotoxin producer 
common in surface water was selected as target for image 
acquisition (shown in Fig. [3]). After two weeks of con¬ 
tinuous culturing at 23° in a nutrient rich medium under 
illumination using a 20 W aquarium bulbs as light source, 
the selected Anabaena flos-aquae reached a steady state 
with a cell count of ~10 6 cells/mL. An aliquot of 20 fjL of 
the prepared sample was mounted on a pre-cleaned quartz 
slide for use in this study. Before image acquisition, the 
sample was placed in a biosafety cabinet for 30 minutes 
to ensure sedimentation and stabilization. Aiming to pro¬ 
vide a visual reference, an inverted fluorescence microscope 
(Eclipse Ti, Nikon, Canada), at a total magnification of 
40X with a resolution of 0.26 ^m was used to obtain a 
bright field microscopy image of the specimen. 

Fig. [3] demonstrates the detailed comparison between 
all mentioned methods, amplitude (a-c) and phase (e-g), 
with a 40X microscopy image (d) and raw recorded holo¬ 
gram (h) shown for reference. In the raw recorded holo¬ 
gram Fig.[3Jh), it can be observed that, due to the use of 
a realistic cultured sample where there may be contami¬ 
nation during media culture preparation, the interference 
patterns are highly complex, making it difficult to use post¬ 
processing methods on the hologram directly to compen¬ 
sate for noise without affecting the patterns. Looking at 
the reconstructed lensfree images using standard method, 
Fig. Ha and e), and the reconstructed lensfree images us¬ 
ing ML estimation Fig.Hb and f), the coupled Anabaena 
filaments on the right side image were difficult to see due 
to interferometric aberrations (in the case of the standard 
method that does not account for such aberrations) and 
low SNR (in both cases), which could lead to underestima¬ 
tion of the number and volume of microorganisms. This 
type of specific underestimation due to numerical error 
could artificially increase the threshold and trigger corre¬ 
sponding treatment actions from decision makers during 
water treatment (e.g. higher dosage of disinfectant or ex¬ 
tra engineered treatment steps) or potentially increase the 
human health risk due to exposure to neurotoxin released 
by Anabaena in water used for human consumption. 

In contrast, the reconstructed lensfree images using the 
proposed method, Fig. He and g), allows for a more reli¬ 
able differentiation between the Anabaena and the back¬ 
ground due to improved SNR. Furthermore, additional de¬ 
tailed morphological features can be distinguished such as 
the hooked tail of the species. In applied microbiology, 
this type of detailed information is very useful for accurate 
detection, enumeration and identification of each specific 
genus or species of microorganism present in environmen¬ 
tal samples. Note that while the FOV in the current setup 
is greater than that of [TTJ, it is smaller than [3] and thus 
is a fundamental limitation of the current setup. 

In this study, we introduce a Bayesian-based method for 
performing aberration correction and numerical diffraction 
that accounts for interferometric aberrations, acquisition 
noise, and reconstruction artifacts to improve the effective 
NA and SNR of the reconstructed image. The ability to 
improve the effective NA and SNR of lensfree on-chip mi¬ 
croscopy images using the proposed method so that the 
morphological characteristics of biological specimens can 


be better visualized and studied can further enhance the 
use and benefits of lensfree on-chip microscopy. Further¬ 
more, increasing lensfree on-chip microscopy image quality 
using the proposed method could lead to improvements in 
tasks used for data analysis such as cell counting [2l[. 
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